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ABSTRACT 


This  thesis  proposes  the  design  of  an  improved  Magnetic,  Angular  Rate, 
Gravity  (MARG)  Body  Tracking  System.  The  current  MARG  Body  Tracking  System  is 
limited  to  tracking  three  limb-segments.  The  MARG  sensors  are  physically  connected  to 
a  desktop  computer  by  cables. 

In  this  thesis,  a  multiplexing  circuit  was  implemented  to  allow  tracking  of  15 
limb-segments.  Processing  was  moved  from  a  desktop  computer  to  a  wearable  computer 
and  wireless  communication  was  implemented  using  an  IEEE  802.11b  spread  spectrum 
wireless  LAN.  The  resultant  system  is  able  to  track  the  entire  human  body  and  is 
untethered.  The  range  of  the  system  is  the  same  as  that  of  the  wireless  LAN  which  can  be 
extended  with  the  use  of  repeaters.  This  thesis  work  will  ultimately  allow  human 
insertion  into  virtual  environments  for  training  and  other  applications. 
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EXECUTIVE  SUMMARY 


This  thesis  proposes  the  design  of  an  improved  Magnetic,  Angular  Rate,  Gravity 
(MARG)  Body  Tracking  System.  MARG  sensors  contain  three  sensors  triads  for  a  total 
of  nine  sensors:  three  magnetometers,  three  angular  rate  sensors  and  three  linear 
accelerometers.  In  the  current  MARG  Body  Tracking  System,  each  MARG  sensor  is 
wired  to  it  own  dedicated  analog  to  digital  (A/D)  converter.  The  A/D  converters  are 
mounted  in  a  desktop  computer  which  performs  the  orientation  calculations.  The  current 
system  can  only  track  three  limb  segments  and  its  working  radius  is  approximately  five 
feet.  This  thesis  improves  upon  the  current  design  by  allowing  the  wireless  tracking  of  15 
limb-segments. 

The  migration  to  wireless  body  tracking  was  planned  in  two  phases.  The  first 
phase  replaces  the  desktop  computer  with  a  computer  small  enough  to  be  worn  or  carried. 
The  sensors  will  still  be  connected  to  the  wearable  computerby  cables,  but 
communications  between  the  wearable  computer  and  the  “rest  of  the  world”  will  be  over 
a  wireless  link.  This  expands  the  working  volume  to  the  range  of  the  wireless  link.  The 
second  phase  replaces  the  cables  between  the  wearable  computer  and  the  sensors  with  a 
Bluetooth  wireless  link.  This  makes  the  system  less  cumbersome  and  easier  to  wear.  The 
second  phase  has  not  yet  been  completed. 

The  first  task  of  Phase  I  was  to  develop  a  multiplexing  circuit  which  allows  a 
single  PCMCIA  analog  to  digital  converter  to  sample  15  MARG  sensors.  In  the  old 
system  the  A/D  converters  ran  at  their  maximum  sampling  rate.  The  multiplexing  circuit 
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of  the  new  system  requires  the  CPU  to  control  each  sample.  This  resulted  in  a  significant 
increase  in  CPU  workload. 

The  second  task  of  Phase  I  was  to  establish  a  wireless  link  between  the  wearable 
computer  and  remote  computers.  This  was  implemented  using  an  IEEE  802.1  lb  spread 
spectrum  wireless  LAN.  The  wireless  connection  did  not  adversely  affect  the 
performance  of  the  system.  The  range  of  the  system  is  the  same  as  that  of  the  wireless 
LAN  and  can  be  extended  with  the  use  of  repeaters. 

The  goal  of  Phase  II  was  to  replace  the  cabling  between  the  MARG  sensors  and 
the  wearable  computer  with  a  second  wireless  link.  This  link  is  to  be  implemented  using 
Bluetooth  transceiver  modules.  Use  of  the  Bluetooth  modules  requires  the  MARG 
sensors  to  have  an  embedded  controller  and  an  A/D  converter. 

As  previously  stated,  each  MARG  sensor  has  nine  analog  channels.  AT) 
converters  are  normally  limited  to  eight  analog  input  signals.  If  the  MARG  sensor  could 
be  redesigned  with  eight  analog  channels,  the  goal  of  Phase  II  would  be  easily  realizable. 
The  approach  taken  was  to  measure  eight  channels  and  calculate  the  ninth  channel.  A 
series  of  static  and  dynamic  tests  were  performed.  The  system  worked  using  only  eight 
analog  signals  but  there  was  a  degredation  in  performance.  Because  the  needed  Bluetooth 
modules  were  not  able  to  be  acquired  at  the  time,  work  on  Phase  II  was  halted. 

This  thesis  demonstrated  the  feasibility  of  a  wireless  MARG  body  tracking 
system  capable  of  sampling  five  MARG  sensors  at  100  Hz  and  15  MARG  sensors  at  37 
Hz.  The  working  radius  of  the  system  was  increased  from  five  feet  to  the  range  of  the 
wireless  LAN. 
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I.  INTRODUCTION 


A.  MOTIVATION 

Virtual  environments  (VE)  are  playing  an  ever  increasing  role  in  today’s  world. 
From  movies  and  commercials  to  education  and  training,  people  are  using  VE  to  allow 
visualizations  which  would  be  too  hazardous  or  expensive  to  create  using  other  methods 
[Ref.  1.].  Inserting  humans  in  VE’s  has  been  a  long  stated  desire  of  VE  developers  [Ref. 
2.]. 

Immersion  into  a  VE  would  presumably  require  data  input  to  all  five  senses  as 
well  as  speech  recognition  and  body  position  detection.  Current  technology  allows  very 
realistic  visual  and  aural  immersion.  Speech  recognition  technology  has  also  reached  a 
passing  level  of  acceptability.  Taste  and  smell  are  far  behind  but  are  not  viewed  as 
essential.  The  two  remaining  areas;  body  position  and  haptic  feedback  are  critical  to 
human  immersion  and  are  not  sufficiently  advanced. 

While  there  are  several  body  tracking  systems  available,  they  all  suffer  from  one 
or  more  of  the  following  problems:  limited  range,  limited  resolution,  high  latency  and 
high  cost.  Many  of  the  systems  are  cumbersome  and  awkward  for  the  user. 

A  Human  Body  Tracking  System  based  on  the  use  of  a  Magnetic,  Angular  Rate 

and  Gravity  (MARG)  sensor  and  quaternion  attitude  filter  was  developed  to  overcome  the 

problems  associated  with  other  body  tracking  systems  [Ref.  3.].  While  the  proof  of 

concept  demonstrator  performed  well  in  tracking  three  human  limb  segments,  it  required 

the  user  to  wear  sensors  which  were  physically  attached  to  a  desktop  computer  by  means 

of  three  15  conductor  cables.  The  cables  are  short  and  bulky  and  confine  the  users 
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movements  to  a  very  small  area.  Each  of  the  three  sensors  required  an  ISA  slot  on  the 
computer’s  motherboard  for  the  analog  to  digital  converter.  This  limited  the  number  of 
sensors  to  the  number  of  available  ISA  slots  on  the  motherboard  and  preclude  full  body 
tracking. 

The  purpose  of  this  thesis  is  to  redesign  the  system  to  allow  wireless  tracking 
using  15  MARG  sensors.  This  will  allow  untethered,  full  body  tracking  over  a  large  area. 

B.  RESEARCH  OBJECTIVES 

The  objectives  of  this  thesis  are  the  following: 

-  design  an  expanded  channel,  wireless  version  of  the  existing  MARG  Body 
Tracking  System, 

-  examine  the  performance  of  the  system  using  a  MARG  sensor  with  a 
reduced  number  of  analog  output  signals. 

C.  ORGANIZATION  OF  THESIS 

Chapter  II  of  this  thesis  provides  background  information  on  human  modeling, 
detecting  position/orientation,  reference  frames  and  filters.  Chapter  III  presents  an 
overview  of  the  current  MARG  Body  Tracking  System.  Chapter  IV  details  the  design  and 
implementation  of  the  wireless  version  of  the  system.  Chapter  V  examines  the 
performance  of  a  MARG  sensor  with  a  reduced  number  of  analog  output  signals.  Chapter 
VII  presents  a  summary,  analysis  of  results,  conclusions  and  suggestions  for  future  work. 
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II.  BACKGROUND 


A.  INTRODUCTION 

Before  building  a  body  tracking  system,  the  “body”  must  be  defined.  Having 
defined  the  body,  how  is  its  position  and  orientation  determined?  What  types  of  sensors 
lend  themselves  to  this  application?  Once  a  sensor  is  selected,  how  will  raw  data  be 
processed  into  position  and  orientation  information?  How  will  this  information  be 
represented?  This  chapter  shows  how  these  issues  were  addressed  during  the  design  of 
the  MARG  body  tracking  system.  It  gives  a  brief  introduction  to  human  modeling, 
position/orientation  sensing,  and  data  processing. 

B.  HUMAN  MODELING 

The  simplest  model  of  the  human  body  is  a  single  point  in  space.  At  the  other  end 
of  the  spectrum,  the  human  body  could  be  modeled  as  skeleton  composed  of  500  separate 
bones  which  are  surrounded  by  over  1000  muscles  encased  inside  an  outer  skin.  The  first 
extreme  is  not  particularly  useful.  While  the  other  extreme  is  desirable  for  realism,  it  is 
too  computationally  intensive  for  real-time  interaction  with  VE’s.  The  choice  of  a  model 
is  therefore  a  trade  off  between  realism  and  computational  speed.  [Ref.  4.] 

Rather  than  focusing  on  bones  and  muscles,  the  body  could  be  modeled  as  an 
articulated  structure  comprised  of  rigid  segments  [Ref.  5.].  Still,  with  over  200  joints  in 
the  human  skeleton,  one  must  decide  on  the  minimum  set  required  to  give  a  useful 
representation  capable  of  being  represented  in  real  time.  If  the  fingers  and  facial  features 
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are  excluded,  a  15  segment  model  can  be  formed  as  follows:  head,  torso,  pelvis,  upper 
arms,  forearms,  hands,  upper  legs,  lower  legs,  and  feet.  [Ref.  4.] 


Shoulter 


Upper  arm 


Forearm 


Lower  Leg 

Ankle 


Head 

Neck 

Torso 

Etbow 

Wrisi 

Upper  Leg 

Knee 

’‘—Foot 


Figure  1.  Human  Body  Model  After  Ref.  [4.] 


C.  DETECTING  POSITION  AND  ORIENTATION 

Having  decided  on  a  model,  how  can  it  be  positioned  and  oriented?  There  are 
several  tracking  systems  on  the  market  based  on  various  sensor  technologies.  They  are 
broadly  categorized  as  mechanical,  inertial,  optical,  magnetic,  acoustic,  radio  frequency 
and  hybrid.  Each  type  was  evaluated  on  its  resolution,  ease  of  use,  working  volume  and 
cost. 
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1. 


Mechanical 


There  are  two  basic  types  of  mechanical  trackers:  exoskeletal  body  suit  and 
ground-based  system  [Ref.  2.].  The  exoskeletal  body  suit  measures  joint  angles  directly 
while  the  ground  based  system  measures  body  position  with  respect  to  a  fixed  point  on 
the  ground  [Ref.  6.].  Some  exoskeletal  systems  have  the  added  advantage  of  providing 
limited  haptic  feedback  [Ref.  7.]. 

Mechanical  trackers  have  excellent .  performance  and  are  without  equal  in 
detecting  finger  position.  Their  major  drawback  is  that  they  are  cumbersome  and 
awkward  to  use  [Ref.  6.,  8.].  The  ground  based  system  has  the  added  disadvantage  of 
limited  working  volume  [Ref.  9.]. 

2.  Optical 

There  are  two  types  of  optical  systems  currently  on  the  market:  pattern 
recognition  and  image  recognition.  These  systems  are  further  classified  as  inside-out 
(mobile  detectors,  fixed  sources)  or  outside-in  (fixed  detectors,  mobile  sources)  [Ref.  1.]. 

The  pattern  based  systems  typically  use  a  set  of  infrared  LED’s  and  detectors.  The 
detectors  (in  an  inside-out  system)  are  mounted  to  the  object  to  be  tracked  and  the 
emitters  are  arranged  in  a  fixed  pattern.  The  system  determines  the  location  of  the  object 
based  on  the  pattern  of  emitters  sensed  by  each  detector.  These  systems  are  very  accurate 

I 

but  are  unable  to  track  in  certain  orientations.  [Ref.  10.] 

Image  recognition  systems  are  far  more  complex.  These  systems  use  cameras  as 
detectors  and  attempt  to  track  movement  by  examining  the  difference  between  captured 
video  frames.  These  systems  are  very  expensive  and  prone  to  errors.  [Ref.  11.] 
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Both  of  the  optical  tracking  systems  require  a  controlled  environment  of  limited 
size,  further  reducing  the  utility  of  the  systems. 

3.  Magnetic 

Magnetic  trackers  are  the  most  widely  used  technology  today.  The  system  uses 
sensors  containing  three  perpendicular  coils  and  an  emitter  system  containing  three  larger 
perpendicular  coils.  Magnetic  fields  are  generated  by  applying  current  to  the  emitter  coils 
in  sequence.  As  the  sensors  are  moved  in  the  presence  of  the  generated  field,  their 
position  and  orientation  can  be  calculated.  These  systems  are  not  as  accurate  as  the 
previously  described  systems  and  they  are  severely  limited  in  range  and  tolerance  to 
noise. 

4.  Acoustic 

Acoustic  trackers  use  one  of  two  methods  to  detect  position;  time-of- 
flight/triangulation  or  phase-coherence  [Ref.  12.][Ref.  1.]. 

In  the  time-of-flight/triangulation  system,  sensors  at  fixed  locations  measure  the 
time  it  takes  for  sound  to  travel  from  the  target.  Once  the  distance  has  been  calculated, 
the  position  is  determined  by  triangulation.  Three  transmitters  and  three  receivers  are 
required  to  obtain  the  position  of  a  single  target.  [Ref.  13.]  Phase-coherence  is  a  more 
sophisticated  system.  In  this  system,  distance  is  determined  by  measuring  the  phase  shift 
between  the  reference  and  the  received  signals.  The  benefits  of  this  system  over  the  time- 
of-flight/triangulation  system  is  an  increase  in  refresh  rates  and  a  somewhat  larger 
working  volume  [Ref.  8.]. 

The  principle  drawbacks  to  the  acoustic  systems  are  the  susceptibility  to  noise  and 
the  requirement  for  a  fixed  working  volume. 
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5.  Radio  Frequency 

RF  positioning  systems,  like  the  acoustic  systems,  are  either  based  on  time-of- 
flight  or  phase  comparison.  Unlike  the  acoustic  systems,  they  enjoy  an  almost  unlimited 
working  volume.  While  RF  positioning  systems  have  long  been  used  for  ships  and 
aircraft,  they  are  not  being  used  for  human  limb  segment  tracking.  Most  of  the  systems 
available  were  not  designed  to  track  such  small  targets  at  short  distances.  Differential 
GPS  has  the  accuracy  needed,  but  will  not  work  indoors. 

6.  Inertial 

i 

Inertial  trackers  integrate  data  from  angular  rate  sensors  to  track  orientation. 
Because  the  angular  rate  sensors  drift,  the  orientation  must  be  corrected  periodically.  By 
using  linear  accelerometers  to  sense  gravity  and  magnetometers  to  sense  the  earth’s 
magnetic  field,  the  drift  can  be  corrected. 

Advances  in  microelectromechanical  systems  (MEMS)  have  made  these  sensors 
small  and  inexpensive.  These  systems  have  an  unlimited  working  volume  but  are 
susceptible  to  magnetic  interference  and  only  detect  orientation. 

D.  DESCRIBING  ORIENTATION  AND  ROTATING  FRAMES 

Having  detected  position  and  orientation,  one  must  find  an  appropriate  way  to 
describe  them.  Given  the  choices  of  coordinate  systems,  frames  of  reference,  rotations 
and  kinematic  models,  there  are  several  of  ways  to  express  this  information.  Since  the 
purpose  of  the  system  is  real  time  tracking  of  human  limb  segments,  the  choice  must  be 
made  with  emphasis  on  computational  efficiency. 
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The  Cartesian  coordinate  system  is  most  commonly  used  to  describe  position  and 
orientation.  It  is  composed  of  three  orthonormal  vectors  (x,  y,  z)  and  constitutes  one 
frame.  In  this  system,  the  position  of  any  point  can  be  described  by  a  3  x  1  vector. 
Another  rotated  frame  is  attached  to  the  point  in  order  to  describe  its  orientation.  There 
are  two  main  ways  of  describing  the  relationship  between  these  frames.  The  first  uses 
angles  of  rotation  and  the  second  uses  quaternions.  There  are  advantages  and 
disadvantages  to  each. 

1.  Angles  of  Rotation 

According  to  Euler,  any  frame  can  be  made  coincident  to  another  frame  by  three 
rotations.  In  the  Fixed-Angle  method,  the  moving  frame’s  orientation  is  described 
relative  to  the  fixed  frame.  Euler  Angles  describe  orientation  with  respect  to  the  moving 
frame.  Rotation  about  each  of  the  three  axis  and  the  order  of  rotation  is  important.  This 
means  there  are  12  ways  of  expressing  Euler  Angles  and  12  ways  for  Fixed-Angles.  [Ref. 
5.] 

While  the  fixed-angle  and  Euler  angle  rotations  are  easy  to  visualize,  they  have  a 
singularity  problem  when  the  pitch  is  +/-  90  degrees.  They  are  also  computationally 
expensive  because  of  their  use  of  trigonometric  functions. 

2.  Quaternions 

0 

Quaternions  are  four  dimensional  representations  of  orientation.  As  such,  they  are 
difficult  to  visualize  and  were  largely  ignored  for  the  last  hundred  years.  Unlike  angle 
based  rotations,  quaternion  rotations  do  not  have  any  singularity  problems  and  require 
fewer  arithmetic  operations  to  perform.  [Ref.  1 .] 
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E.  FILTERS 


In  an  ideal  environment,  the  sensors  would  detect  position  and  orientation  directly 
without  noise  or  error.  Since  this  is  not  the  case,  the  raw  sensor  data  must  be  filtered.  This 
filter  can  be  analog,  digital  or  both.  Analog  filtering  is  mainly  used  for  signal 
conditioning  while  the  digital  filters  are  used  to  convert  sensor  readings  into  position 
information.  The  three  digital  filters  currently  used  are  Weiner,  complementary  and 
Kalman.  Each  is  optimized  for  a  specific  situation. 

1.  Weiner 

The  Weiner  filter  uses  a  weighting  function  approach  to  minimize  the  mean- 
squared  error  between  multiple  measurements  of  a  time  invariant  wide-sensc  stationary 
signal  [Ref.  14].  The  weighting  function  can  be  found  if  the  auto-correlation  and  cross¬ 
correlation  functions  of  the  input  signals  are  known.  The  principle  drawback  of  this  filter 
is  that  all  previous  data  must  be  considered  every  time  new  data  is  acquired.  After  a  short 
period  of  time,  the  calculations  are  no  longer  able  to  be  processed  in  real  time. 

2.  Kalman 

The  Kalman  filter  uses  a  state  space  method  to  minimize  the  mean-squared  error. 
It  is  a  recursive  algorithm  which  depends  only  on  the  last  state  and  current  measurement. 
This  feature  makes  the  Kalman  filter  particularly  well  suited  for  real  time  tracking 
applications.  Kalman  filters  evaluate  the  quality  of  their  estimates  and  adjust  their  gain 
accordingly.  This  allows  them  to  discard  inputs  deemed  unreasonable.  Like  the  Weiner 
filter,  the  autocorrelation  and  crosscorrelation  functions  must  be  known.  [Ref.  14] 

3.  Complementary 

Unlike  the  previous  filters,  the  complementary  filter  makes  no  assumptions  about 

the  spectral  properties  of  the  input  signals.  It  does  however  assume  that  the  measurements 
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of  input  signals  experience  noise  which  is  complementary  in  nature,  i.e.  one  measurement 
has  high  frequency  noise  while  the  other  has  low  frequency  noise.  The  complementary 
filter  low-pass  filters  one  signal  and  high  pass  filters  the  other.  The  cut-off  frequencies  of 
the  filter  coincide  with  each  other  and  the  result  is  a  distortionless  filter.  [Ref.  1.] 
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III.  CURRENT  MARG  BODY  TRACKING  SYSTEM 


A.  INTRODUCTION 

The  work  of  several  researchers  has  lead  to  the  development  of  a  MARG  system 
[Ref.  l.][Ref.  4.] [Ref.  7.] [Ref.  9.].  Their  goal  was  to  demonstrate  the  feasibility  of  full 
body  tracking  using  multiple  MARG  sensors.  The  imlemented  system  is  capable  of 
tracking  three  limb  segments  in  real  time  while  tethered  to  a  desktop  computer.  It  consists 
of  hardware  and  software  and  is  described  in  the  following  paragraphs. 

B.  HARDWARE 

The  hardware  is  comprised  of  three  sub  systems:  MARG  sensor,  analog  to  digital 
converter  and  computer  as  illustrated  in  figure  2.  The  MARG  sensors  are  used  to  sense 
the  physical  environment.  The  analog  signals  outout  by  the  sensorsare  converted  to 
digital  values  and  processed  by  a  desktop  computer. 


Figure  2.  MARG  Body  Tracking  System  Hardware  After  Ref.  [1 .] 
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1. 


MARG  Sensors 


Each  MARG  sensor  contains  three  sensors  triads:  magnetometers,  angular  rate 
sensors  and  linear  accelerometers.  Each  sensor  triad  has  three  orthogonally  mounted 
sensors.  The  axis  of  the  magnetometer  are  coincident  with  those  of  the  angular  rate 
sensors  and  the  linear  accelerometers.  These  nine  sensors,  along  with  their  circuitry,  are 
mounted  in  a  small  wooden  box  measuring  approximately  3"  x  2"  x  1" . 

As  noted  in  the  previous  chapter,  the  angular  rate  sensors  are  used  to  provide 
instantaneous  orientation  information  during  motion.  The  angular  rate  sensors  sometimes 
have  non-zero  reading  while  stationary  (drift).  This  drift  is  corrected  by  the 
magnetometers  and  accelerometers  which  measure  the  earth’s  magnetic  field  and  gravity 
( and  thereby  determine  orientation). 


Figure  3.  MARG  Sensor  From  Ref.  [15.] 
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The  system  uses  CG-16D  angular  rate  sensors  manufactured  by  Tokin. 


Specifications  are  given  in  table  1. 


Characteristic 

Specification 

Reference  Voltage 

2.4  V 

Output  voltage 

0-5  V 

Sensitivity 

1.1  mV/degree/sec  (+/-  20%) 

Maximum  detectable  angular  rate 

+/-  90  deg/sec 

Output  voltage  at  zero  angular  rate 

+/-  500  mV 

Bandwidth 

100  Hz 

Operating  temperature  range 

-5  to  75  C 

Supply  Voltage 

5  V 

Current  consumption 

7mA 

Table  1 .  Tokin  CG-16D  Angular  Rate  sensors  Specifications  After  Ref  .[16.] 


The  accelerometer  is  a  Crossbow  CXL04M3.  It  consists  of  three  orthogonally 
mounted,  0-5g  ADXL05  accelerometers  manufactured  by  Advanced  Micro  Devices.  The 
CXL04M3  has  the  following  specifications: 


Characteristic 

Specification 

Output  voltage 

0-5  V 

Sensitivity 

500  mV/g  (+/-  5%) 

Output  voltage  at  zero  g 

•  2.4-2.6V 

Bandwidth 

DC-100  Hz 

Operating  temperature  range 

-5  to  75  C 

Supply  Voltage 

5  V 

Current  consumption 

24  mA 

Table  2.  Crossbow  CXL04M3  Accelerometer  Specifications  After  Ref.  [17.] 
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The  magnetometer  is  a  Honeywell  HMC2003.  the  specifications  are  given  in 


table  3. 


Characteristic 

Specification 

Reference  Voltage 

2.4  V 

Output  voltage 

0.5 -4.5  V 

Sensitivity 

lV/gauss 

Field  Range 

-2  to  2  gauss 

Resolution 

40  pgauss 

Bandwidth 

1  kHz 

Operating  temperature  range 

-40  to  85  C 

Supply  Voltage 

.  6-15  V 

Current  consumption 

20  mA 

Table  3.  Honeywell  HMC2003  Specifications  After  Ref.  [18.] 


When  the  magnetometers  are  exposed  high  magnetic  fields  (in  excess  of  30 
gauss),  they  become  saturated  and  no  longer  give  accurate  readings.  [Ref.  18.]  The 
magnetometers  include  a  manual  reset  circuit  to  correct  this  problem. 

The  connections  to  the  MARG  sensors  are  by  way  of  a  15  conductor  cable  with  a 
high  density  DB-15  connector.  The  size  of  the  cable  confines  the  movement  of  the 
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sensors  to  a  radius  of  approximately  five  feet.  The  pin-outs  of  the  connector  are  given  in 
table  4. 


Pin  number 

Signal  Description 

1 

5  V 

2 

5  V 

3 

Angular  Rate  X 

4 

Angular  Rate  Y 

5 

Angular  Rate  Z 

6 

Accelerometer  X 

7 

Accelerometer  Y 

8 

Accelerometer  Z 

9 

No  connection 

10 

Magnetometer  X 

.  11 

Magnetometer  Y 

12 

Magnetometer  Z 

13 

Ground 

14 

12V 

15 

Ground 

Table  4.  MARG  Sensor  Pinout 

2.  Analog  to  Digital  Converter 

Each  MARG  sensor  is  connected  to  its  own  National  Instruments  MIO-16XE-50 
analog  to  digital  (A/D)  converter  by  means  of  a  National  Instruments  SCB68  I/O 
connection  board.  The  MIO-16XE  is  a  16-bit  successive  approximation  analog  to  digital 
converter  capable  of  20k  samples  per  second  [Ref.  19.].  The  SCB68  is  a  shielded 
connector  block  [Ref.  20.]. 
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3.  Computer 

The  MIO-16XE-50’s  are  mounted  in  a  Desktop  PC  system  with  an  866  MHz  Intel 
Pentium  III  processor  running  the  Microsoft  Windows  2000  operating  system.  The 
computer  controls  the  operation  of  the  A/D  converter  and  runs  the  software  associated 
with  the  MARG  system.  This  software  is  described  in  the  following  paragraphs. 

C.  SOFTWARE 

The  software  was  written  in  Microsoft  Visual  C++  object  oriented  language.  The 
software  consists  of  a  GUI,  complementary  filter,  calibration  and  animation  routines. 

1.  Complementary  Filter 

The  complementary  filter  high  pass  filters  the  angular  rate  sensor  input  and  low 
pass  filters  the  accelerometers  and  magnetometers.  The  filter  block  diagram  is  given  in 
figure  4. 


F igure  4.  Complementary  Filter  From  Ref.  [21.] 
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2. 


Calibration  Routine 


The  calibration  routine  consists  of  rotating  the  MARG  sensors  through  a  number 
of  orientations  in  order  to  detect  the  maximum,  minimum  and  null  readings.  These  are 
used  to  set  the  scale  factors  for  the  magnetometers,  accelerometers  and  angular  rate 
sensors.  The  calibration  routine  performs  a  number  of  steps  in  parallel  to  minimize  the 
number  of  orientations  and  rotations. 

a.  Accelerometer 

The  accelerometer  maximum  and  minimum  are  found  by  measuring  the 
force  of  gravity  while  the  sensor  is  held  stationary  in  one  of  six  positions;  x-axis  up,  x- 
axis  down,  y-axis  up,  y-axis  down,  z-axis  up  and  z-axis  down.  The  nulls  are  half  way 
between  the  maximum  and  minimum. 

b.  Angular  Rate  Sensor 

The  angular  rate  sensors  are  calibrated  by  integrating  the  sensor’s  output 
while  rotating  it  through  a  known  angle.  The  calibration  routine  averages  the  results  of 
two  rotations;  positive  90  degrees  and  negative  180  degrees.  The  null  values  are 
determined  by  measuring  the  sensor  output  while  the  sensor  is  at  rest. 

c.  Magnetometer 

The  x-axis  magnetometer  is  calibrated  by  pointing  the  x-axis  North, 
rotating  the  sensor  360  degrees  about  the  y-axis  and  recording  the  maximum  and 
minimum  values.  The  y  and  z  axis  are  calibrated  by  pointing  the  y-axis  North  and 
rotating  360  degrees  about  the  x-axis.  This  procedure  allows  the  maximum  and  minimum 
to  be  detected  regardless  of  the  dip  angle  of  the  Earth’s  magnetic  field.  The  null  is 
defined  as  halfway  between  the  maximum  and  minimum. 
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D.  SUMMARY 


The  system  described  in  this  chapter  demonstrated  the  feasibility  of  body  tracking 
using  MARG  sensors.  While  it  performed  well  in  terms  of  cost,  accuracy  and 
computational  efficiency,  it  is  limited  to  tracking  three  limb  segments.  The  five  foot 
working  radius  severely  limits  its  use.  Fortunately,  the  design  was  well  documented  and 
modular  and  relatively  easy  to  modify. 
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IV.  WIRELESS  MARG  BODY  TRACKING  SYSTEM 


A.  INTRODUCTION 

An  ideal  body  tracking  system  would  be  so  small  that  the  user  would  not  even 
notice  it  and  have  an  unlimited  working  volume.  While  the  sensors  in  the  existing  MARG 
systems  are  somewhat  bulky,  the  principle  drawback  is  the  requirement  for  the  user  to  be 
tethered  to  a  desktop  computer. 

The  migration  to  wireless  body  tracking  was  planned  in  two  phases.  The  first 
phase  replaces  the  desktop  computer  with  a  computer  small  enough  to  be  worn  or  carried. 
The  sensors  will  still  be  connected  by  cables,  but  communications  between  the  wearable 
computer  and  the  “rest  of  the  world”  will  be  over  a  wireless  link.  This  expands  the 
working  volume  to  the  range  of  the  wireless  link. 

The  second  phase  replaces  the  cables  between  the  wearable  computer  and  the 
sensors  with  another  wireless  link.  This  makes  the  system  less  cumbersome  and  easier  to 
wear.  This  phase  has  not  yet  been  completed. 

B.  PHASE  I 

Moving  from  a  desktop  computer  to  a  wearable  computer  involved  three  main 
issues;  selecting  a  wearable  computer,  handling  the  analog  to  digital  conversion  and 
communicating  over  a  wireless  link.  The  following  paragraphs  show  how  these  issues 
were  addressed. 
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1.  Wearable  Computer 

While  laptop  computers  are  significantly  smaller  than  their  desktop  counterparts, 
they  are  still  too  big  to  be  carried  comfortably.  However,  there  are  many  classes  of 
systems  smaller  than  laptops:  notebooks,  subnotebooks,  handhelds  and  palmtops.  Size 
was  not  the  only  consideration;  computing  power,  software  compatibility,  data 
acquisition  and  wireless  support  are  also  important  factors. 

The  original  software  was  written  in  C++  and  compiled  for  Intel  x86  compatible 
processors.  The  software  uses  Microsoft  Foundation  Classes  (MFC)  which  requires  that 
the  code  to  be  run  in  a  Windows  environment.  Since  funding  was  limited,  the  decision 
was  made  to  use  the  software  in  its  existing  form.  The  compatibility  requirements 
eliminated  the  palmtop  and  handheld  class  systems. 

Wireless  support  was  available  in  all  classes  of  computer  systems  under 
consideration.  Several  of  these  systems  supported  multiple  wireless  modes  including 
infrared,  spread-spectrum  radio  modems  and  cell  phones.  No  systems  were  eliminated 
because  of  this  requirement. 

The  final  requirement  was  that  of  data  acquisition.  Support  for  high  bandwidth 
data  acquisition  existed  only  in  the  computers  with  PCMCIA  slots. 

Of  systems  considered,  two  met  all  the  requirements:  ViA’s  Wearable  PC  and 
Xybemaut’s  Mobile  Assistant.  The  latter  system  was  chosen  because  of  it  processor 
speed.  The  specifications  for  both  systems  are  given  in  table  5. 
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Size  (L  x  W  x  H) 

Weight _ 

Processor 
Operating  System 
Memory 
Hard  drive 
PCMCIA  slots 
I/O 


Detachable  display 
Table  5. 


ViA  Wearable  PC 


Xybemaut  Mobile  Assistant 


9.75x3x1.25 


4.6  x  7.5  x  2.5 


22  oz 


28  oz 


166MHz  Cyrix 


233MHz  Pentium  MMX 


Microsoft  Windows  98 


Microsoft  Windows  98 


64MB 


32MB 


6.2GB 


12GB 


Two  Type  II  or  one  Type  III 


Two  Type  II  or  one  Type  III 


Full  duplex  audio,  RS-232, 
USB 


Full  duplex  audio,  RS-232, 
USB 


yes 


yes 


Wearable  Computer  Specifications  After  Ref.  [22.] [23.] 


Figure  6.  Xybemaut  Mobile  Assistant  PC 


2.  Analog  to  Digital  Conversion 

In  choosing  an  analog  to  digital  converter,  three  factors  were  considered:  speed, 
resolution  and  number  of  input  channels.  The  original  system  used  a  single  channel,  16 
bit,  20k  Samples/second  analog  digital  converter  for  each  MARG  sensor. 

While  16  bit  PCMCIA  A/D  converters  are  available,  they  are  significantly  more 
expensive  than  the  12  bit  cards.  To  determine  the  number  of  bits  needed,  sensor 
specifications  and  desired  resolution  of  the  overall  system  were  considered. 

The  MARG  sensors  use  magnetometers  to  sense  the  earth’s  magnetic  field.  This 
field  is  on  the  order  +/-  0.6  gauss  depending  on  orientation.  The  HMC2003 
magnetometers  have  a  resolution  of  40  pgauss.  15  bits  are  required  to  capture  the  entire 
useful  range  of  the  HMC2003  magnetometers. 

The  MARG  sensors  use  linear  accelerometers  to  sense  static  acceleration  due  to 
the  earth’s  gravity.  The  ADXL05  accelerometers  have  a  resolution  of  5  mg.  Gravity  is  +/- 
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1  g  depending  on  orientation.  Nine  bits  are  required  to  capture  the  useful  range  of  the 
ADXL05  accelerometers. 

From  a  system  perspective,  16  bits  of  resolution  would  theoretically  allow 
orientation  tracking  accuracy  on  the  order  of  a  few  thousandths  of  a  degree.  This  level  of 
tracking  might  be  appropriate  for  tracking  eye  or  finger  movement  but  it  is  well  beyond 
the  goal  of  this  research.  12  bits  of  data  will  theoretically  allow  orientation  tracking 
accuracy  within  a  tenth  of  a  degree.  Based  on  the  system  requirements  and  the  resolution 
of  the  ADXL05,  a  12  bit  A/D  converter  was  deemed  sufficient. 

The  MIO-16XE-50  used  in  the  original  system  had  a  maximum  sampling  rate  of 
20k  samples/second.  This  rate,  divided  by  the  number  of  channels,  yields  the  sampling 
rate  per  channel.  Since  the  MARG  sensors  use  nine  channels,  the  maximum  sampling 
rate  per  channel  is  2.22k  samples/second.  The  wireless  system  will  only  have  one  A/D 
converter  and  will  support  15  MARG  sensors.  To  maintain  the  current  per  channel 
sampling  rate,  the  A/D  converter  will  need  300k  samples/second. 

The  MARG  sensors  have  a  maximum  bandwidth  of  100Hz.  Nyquist's  Theorem 
puts  the  minimum  sampling  rate  at  200  Hz.  This  value  was  set  as  the  minimum  sampling 
rate  per  channel. 

The  previous  system  used  a  16  channel  A/D  converter  for  each  MARG  sensor. 
There  is  only  one  PCMCIA  slot  available  so  the  wireless  system  is  limited  to  one  A/D 
converter.  With  nine  channels  per  MARG  sensor  and  15  MARG  sensors  in  the  system, 
the  A/D  converter  needs  to  support  135  channels.  PCMCIA  A/D  converters  are  limited  to 
16  channels.  These  channels  require  external  multiplexing  to  support  the  required  135 
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channels.  To  support  an  external  multiplexing  circuit,  the  A/D  converter  needs  to  have 
digital  input/output  capability. 

With  135  channels  and  a  200  Hz  per  channel  sampling  rate,  an  A/D  converter 
withh  a  minimum  sampling  rate  at  27k  samples/second  is  required.  PCMCIA  A/D  cards 
have  maximum  sampling  rates  between  100k  samples/second  and  625k  samples/second 
so  this  requirement  was  not  difficult  to  meet. 

Quatech’s  DAQP-12  met  all  of  the  above  requirements  and  was  selected  for  use 
in  the  wireless  system.  Its  specifications  are  listed  in  table  6  and  its  pin-outs  are  in  table 
7. 


Characteristic 

Specification 

Sampling  Rate 

1  OOKSamples/second 

Analog  Input  Resolution 

12  Bits 

Analog  Inputs 

8  differential 

1 6  single-ended 

Acquisition  +  Conversion  Time 

2  ms  +  8ms 

Programmable  Gain 

1,2, 4,8 

Digital  Input/Output  channels 

4/4 

Table  6.  Quatech  DAQ-12P  Specifications  After  Ref.  [24.] 
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Hirose-32 

D-37 

Function 

32 

37 

Channel  0  (+) 

Channel  0 

31 

18 

Channel  0  (-) 

Channel  8 

30 

36 

Channel  1  (+) 

Channel  1 

29 

17 

Channel  1  (-) 

Channel  9 

28 

35 

Channel  2  (+) 

Channel  2 

27 

16 

Channel  2  (-) 

Channel  10 

26 

34 

Channel  3  (+) 

Channel  3 

25 

15 

Channel  3  (-) 

Channel  1 1 

24 

33 

Channel  4  (+) 

Channel  4 

23 

14 

Channel  4  (-) 

Channel  12 

22 

32 

Channel  5  (+) 

Channel  5 

21 

13 

Channel  5  (-) 

Channel  13 

20 

31 

Channel  6  (+) 

Channel  6 

19 

12 

Channel  6  (-) 

Channel  14 

18 

30 

Channel  7  (+) 

Channel  7 

17 

11 

Channel  7  (-) 

Channel  15 

16 

28 

Ground 

15 

10 

Full  power 

14 

26 

Synchronous  Sample  Hold 

13 

25 

Digital  in  bit  0 

12 

6 

Digital  in  bit  1 

11 

24 

Digital  in  bit  2 

10 

5 

Digital  in  bit  3 

9 

23 

Digital  out  bit  0  (latched) 

8 

4 

Digital  out  bit  1  (latched) 

7 

22 

Digital  out  bit  2  (latched) 

6 

3 

Digital  out  bit  3  (latched) 

5 

28 

Ground 

4 

28 

Ground 

3 

19 

Ground 

2 

19 

Ground 

1 

27 

Reserved 

Table  7.  Quatech  DAQ-12P  Pinout  After  Ref.  [24.' 
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After  selecting  the  A/D  converter,  an  analog  multiplexer  (mux)  had  to  be  selected. 
With  16  channels  on  the  A/D  converter  and  a  requirement  for  135,  an  8.4375:1 
multiplexer  was  needed.  Multiplexers  are  available  in  2,  4,  8  and  16  channels.  The  16:1 
mux  was  chosen.  There  are  only  a  few  companies  which  manufacture  16:1  mux’s  and 
only  one  type  was  available  at  the  time.  This  was  the  ADG-526A  manufactured  by 
Analog  Devices.  Based  on  availability,  the  ADG-526A  was  selected  for  use.  Its 
specifications  are  listed  in  table  8  and  its  pinouts  are  in  table  9. 


Parameter 

Value 

Ron 

4500  max 

^TRANSITION 

400  ns  max 

toPEN 

400  ns  max 

t0N(EN,  WR*) 

400  ns  max 

t0FF(EN,  RS*) 

400  ns  max 

tw  Write  Pulse  Width 

120  ns  min 

ts  Address,  Enable  Setup  Time 

100  ns  min 

tn  Address,  Enable  Hold  Time 

10  ns  min 

tRs  Reset  Pulse  Width 

100  ns  min 

Table  8.  Analog  Devices  ADG-526A  Specifications  After  Ref.  [25.] 
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Pin 

Function 

Pin 

Function 

1 

VDD 

15 

D 

2 

NC 

16 

VSS 

3 

S16 

17 

S8 

4 

S16 

18 

S7 

5 

S15 

19 

S  6 

6 

S14 

20 

S5 

7 

S13 

21 

S4 

8 

S12 

22 

S3 

9 

Sll 

23 

S2 

10 

S10 

24 

SI 

11 

S9 

25 

EN 

12 

GND 

26 

AO 

13 

WR* 

27 

A1 

14 

A3 

28 

A2 

Table  9.  Analog  Devices  ADG-526A  Pinout  After  Ref.  [25.] 


a.  Multiplexing  Hardware 

The  multiplexing  circuit  could  be  implemented  in  two  ways.  The  first  was 
to  mux  like  signals  from  the  different  MARGs  and  feed  each  signal  type  to  a  separate 
A/D  channel  as  shown  in  figure  7.  The  second  was  to  mux  all  the  signals  at  each  MARG 
and  give  each  MARG  a  separate  channel  as  shown  in  figure  8. 
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MARG  Sensor  15 


Figure  7.  Multiplexing  by  Signal  Type 
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16:1  Mux 

Figure  8.  Multiplexing  by  Sensor  Output 


The  benefit  of  multiplexing  like  signals  from  different  MARG  sensors  is 
that  only  nine  multiplexers  are  required.  Multiplexing  all  signals  at  each  MARG  sensor 
requires  15  multiplexers  but  has  two  advantages:  it  reduces  the  cabling  requirements  from 
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14  to  7  (one  signal,  four  control,  one  power  and  one  ground)  and  it  reduces  the  number  of 
times  a  digital  control  signal  needs  to  be  sent  in  each  cycle  (9  vs.  15).  The  decision  was 
made  to  multiplex  all  signals  at  each  MARG  sensor. 

The  multiplexer’s  address  select  lines  were  connected  to  four  of  the  DAQ- 
12P  digital  input/output  lines  and  the  analog  out  lines  were  run  to  the  appropriate  DAQ- 
12P  channel.  The  ADG526A  can  latch  the  address  select  lines,  but  this  feature  was  not 
needed  since  the  DAQ-12P  latches  its  digital  output  lines.  Therefore  WR*  was  tied  low, 
while  RS*  and  EN  were  tied  high.  After  the  circuit  was  wire-wrapped,  and  a  short  test 
program  was  written. 

As  stated  earlier,  the  required  sampling  rate  was  27k  samples  second.  The 
DAQ-12  was  rated  at  100k  samples/second  which  translates  to  lOps  per  sample.  The 
ADG526A’s  maximum  switching  time  (transition )  was  specified  as  400ns.  Sampling  at 
twice  200  Hz  requires  1800  transitions.  The  ADG526A  needs  720ps  for  this.  This  leaves 
the  DAQ-12P  999.28ms  out  of  every  second  to  acquire  the  data.  Using  lOps  per  sample, 
the  DAQ-12P  should  be  able  to  acquire  999.28k  samples.  This  is  well  above  the  stated 
requirement. 

Additional  overhead  for  using  the  DAQ-12P’s  digital  input  output  was 
anticipated,  but  the  exact  amount  was  not  known.  A  short  test  program  showedt  he  delay 
was  and  order  of  magnitude  higher  than  expected.  The  DAQ-12  achieves  its  100k 
samples/second  only  during  uninterrupted  A/D  conversions.  By  forcing  digital  I/O  in 
between  A/D  conversions,  the  rate  drops  to  10k  samples/second.  For  15  MARG  sensors, 
the  sampling  rate  is  74  Hz,  well  below  the  200  Hz  minimum.  The  system  could  support 

five  MARG  sensors  at  200  Hz.  The  specifications  for  the  several  other  PCMCIA  A/D 
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cards  were  reviewed  and  none  of  them  make  any  mention  of  the  effects  of  digital  I/O  on 
sampling  rate. 

To  make  the  multiplexing  circuit  work  at  a  constant  200  Hz  for  all  15 
MARG  sensors,  the  address  would  need  to  be  generated  by  a  sequencing  circuit.  The 
sequencing  circuit  would  need  to  be  synchronized  to  the  A/D  converter. 

At  the  time,  there  were  only  three  MARG  sensors  available  and  the 
decision  was  made  to  continue  the  project  as  is. 

b.  Analog  to  Digital  Converter  Software 

The  existing  code  has  a  class  called  CAtoDConverter.  This  class  called 
various  device  driver  routines  for  the  National  Instruments  PCI-MIO-16XE-50  and 
supplied  raw  digital  data  to  the  classes  CSampler  and  CSensorCalibrater.  Figure  9 
shows  the  flow  of  data. 


MARG  Sensor  Data 


Figure  9.  Original  Class  Diagram  After  Ref.  [1 .] 
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CAtoDConverter  was  divided  into  two  new  classes;  CNiADC  and 
CSensorData.  CNiADC  contained  the  code  for  driving  the  PCI-MI O-16XE-50  and 
CSensorData  passed  data  to  CSampler  and  CsensorCalibrater .  Another  class,  CQADC, 
was  created  containing  the  device  driver  calls  for  the  DAQ-12P.  This  is  illustrated  in 
figure  10.  The  GUI  was  then  modified  to  let  the  user  select  the  appropriate  data 
acquisition  device. 


MARG  Sensor  Data 


Figure  10.  Class  Diagram  with  PCMCIA  Data  Acquisition 

The  system  performed  as  expected  and  the  migration  to  the  PCMCIA  data 
acquisition  card  was  complete.  The  last  remaining  task  in  Phase  I  was  the  implementation 
of  the  wireless  link. 

3.  Wireless  Link 

There  are  many  ways  of  implementing  a  wireless  link;  infrared,  cellular  phone, 
radio  modem.  The  desire  to  have  a  large  working  volume  precluded  the  use  of  IR  links. 
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The  requirement  to  track  15  human  limbs  segments,  necessitated  a  data  rate  of  165kbps. 
This  ruled  out  cellular  phones  and  spread  spectrum  radio  modems. 

Many  spread  spectrum  radios  are  able  to  act  like  a  hardwired  Ethernet  connection 
and  are  transparent  to  the  user.  The  range  of  these  systems  vary  but  are  generally  in  the 
neighborhood  of  50  to  200  feet  [Ref.  26.].  Most  support  data  rates  of  1Mbps  [Ref.  26.]. 
These  systems  are  available  as  PCMCIA  cards  and  were  compatible  with  the  wearable 
computers.  The  decision  was  made  to  implement  the  wireless  link  with  these  devices 
using  the  Internet  Protocol  (IP). 

The  IP  communication  wasimplemented  in  a  new  class,  CNetwork.  Since  the 
CSensorData  could  already  accept  data  from  two  different  A/D  converters,  it  was 
relatively  straight  forward  adding  a  third  source,  CNetwork.  CSensorData  was  then 
modified  to  send  data  from  the  A/D  cards  to  CNetwork  as  shown  in  figure  11. 


MARG  Sensor  Data 


Figure  1 1 .  Class  Diagram  with  Network  Capability 
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In  addition  to  sending  and  receiving  sensor  data,  CNetwork  class  was  responsible 
for  coordinating  the  transfer  of  the  data.  Figure  12  shows  how  this  communication  was 


handled. 

Wearable  Computer 


Respond 


Stream  sensor  data 


Stream  sensor  data 


Is  data  available? 


◄ - 

Yes,  three  channels. 

. . . .  .  .  . 

Ld 

W 

◄ — 

Send  data. 

MARG  sensor  data. 


MARG  sensor  data. 


Remote  Computer 

Send  Message 


Send  Message 


Stream  sensor  data 


Stop  data  stream 


MARG  sensor  data. 


End  data  stream. 


Send  Message 


Figure  12.  Flow  of  Network  Communication 


The  two  types  of  communication,  command  messages  and  streaming  data,  are 
different  in  nature  and  have  different  requirements.  The  command  messages  required 
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reliable  were  not  time  critical.  The  command  messages  are  also  short  and  occur  only  a 
few  times  during  the  execution  of  the  program. 

The  MARG  sensor  data  is  longer  than  the  command  messages  and  occurs  a 
hundred  times  every  second.  It  has  a  very  short  lifespan.  Rather  than  waiting  for  a 
delayed  or  lost  set  of  MARG  sensor  data  to  be  resent  the  system  simply  ignores  it  and 
processes  the  next  available  data. 

There  are  two  ways  of  using  IP,  Transmission  Control  Protocol  (TCP)  and  User 
Datagram  Protocol  (UDP).  TCP  is  a  connection  based  protocol  that  provides  reliable 
network  communication.  It  ensures  that  packets  are  received  in  the  order  they  are  sent.  If 
a  packet  becomes  lost,  it  makes  sure  the  packet  is  resent.  UDP  is  a  protocol  that  sends 
independent  packets  of  data  without  regard  for  reliability.  The  advantage  of  UDP  is  that  it 
is  faster  than  TCP.  For  the  sensor  data,  speed  and  not  reliability  was  needed.  UDP  was 
well  suited  for  this.  The  command  messages  need  reliability,  so  they  were  sent  using 
TCP. 

4.  Testing 

The  system  was  tested  in  a  number  of  configurations  during  Phase  I.  The  first  step 
involved  using  a  Pentium  II  class  laptop  computer  hardwired  to  the  local  area  network 
(LAN)  and  later  connected  to  the  LAN  via  the  wireless  link.  Then  the  tests  were  repeated 
on  the  Xybemaut  system. 

While  running  the  filter  and  animation  algorithms,  the  laptop  computer  was  not 
able  to  acquire  the  sensor  readings  at  the  requisite  sampling  rate.  In  the  original  MARG 
system,  once  the  A/D  cards  were  initialized  they  performed  the  sampling  and  conversion 

without  supervision  from  the  computer.  In  the  wireless  system,  the  computer  had  to 
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control  the  external  multiplexing  circuit  for  every  sample.  This  greatly  increased  the 
workload  of  the  computer.  With  the  filter  disabled,  the  system  performed  as  required  in 
both  the  hardwired  and  wireless  LAN  configurations.  The  tests  were  then  repeated  on  the 
wearable  computers  with  similar  results. 

C.  PHASE  II 

The  second  phase  of  the  project  was  to  replace  the  remaining  MARG  sensor 
cabling  with  another  wireless  link.  The  driving  factor  for  the  Phase  I  wireless  link  was 
long  range.  Phase  II’s  link  only  needed  a  range  of  a  few  feet  and  a  transceiver  had  to  be 
packaged  with  each  sensor.  Since  multiple  transceiver  were  operating  in  the  same  area, 
emphasis  was  placed  on  the  links  protocol. 

IR  systems  met  all  the  requirements  but  were  limited  to  line  of  sight 
communication.  Since  this  could  not  be  guaranteed,  IR  systems  were  ruled  out. 

This  left  only  the  radio  systems.  There  are  a  number  of  proprietary  radio  systems 
but  an  open-system  was  For  compatibility  reasons,  open-systems  were  given  preference 
over  proprietary  systems. 

The  much  heralded  Bluetooth  technology  seemed  like  a  perfect  match.  It’s  range 
is  on  the  order  of  ten  meters  and  boasts  a  bandwidth  of  1Mbps.  Bluetooth  PCMCIA  cards 
have  been  developed  as  have  embedded  Bluetooth  modules. 

The  wearable  computers  have  two  PCMCIA  slots;  one  used  for  the  Phase  I 
wireless  link  and  the  other  for  A/D  conversion.  Since  the  wearable  computer  didn’t  have 
built  in  support  for  Bluetooth,  one  of  the  cards  had  to  be  removed.  The  DAQ-12P  did  not 
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perform  as  expected,  so  it  was  removed.  This  required  the  A/D  conversion  to  take  place 
inside  the  MARG  sensor.  There  are  several  A/D  converter  chips  currently  on  the  market 
but  they  are  generally  limited  to  eight  channels.  The  multiplexing  circuit  previously 
described  would  still  be  necessary. 

The  Bluetooth  module  embedded  in  the  MARG  sensor  will  need  a  controller  to 
coordinate  the  transfer  of  data.  While  it  would  still  be  desirable  to  eliminate  the  cabling, 
this  should  not  be  accomplished  at  the  expense  of  increasing  the  size  of  the  MARG 
sensor.  Several  embedded  controllers  have  built  in  A/D  converters  so  the  footprint  of  the 
system  would  not  increase.  Like  the  A/D  converter  chips,  embedded  controllers  are 
typically  limited  to  eight  analog  channels. 

Unfortunately,  Bluetooth  has  not  made  it  to  the  market  as  fast  as  anticipated  and 
the  rest  of  Phase  II  was  put  on  hold.  Attention  was  now  directed  to  the  issue  of  limited 
analog  channels. 


D.  SUMMARY 

Phase  I  demonstrated  the  feasibility  of  a  wireless  MARG  body  tracking  system. 
While  the  goal  of  tracking  15  limb  segments  at  100  Hz  was  not  reached,  the  capability 
was  raised  from  three  MARG  sensors  to  five. 

The  Phase  II  design  moved  the  A/D  conversion  to  the  MARG  sensor  and 
eliminated  the  PCMCIA  A/D  conversion  bottleneck. 

Both  phases  faced  a  major  challenge  in  the  number  of  A/D  channels.  It  was 
decided  that  the  need  for  nine  analog  output  channels  should  be  examined. 
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V.  MARG  SENSOR  WITH  EIGHT  ANALOG  SIGNALS 


A.  INTRODUCTION 

Multiplexers  are  switches  which  are  controlled  by  bi-level  logic.  The  size  and 
complexity  of  the  multiplexers  grow  by  powers  of  two.  Ideally,  a  multiplexing  circuit 
will  have  2"  channels.  These  boundaries  are  2,  4,  8,  16,  etc.  The  MARG  sensor  with  its 
nine  analog  channels  requires  a  system  with  twice  the  complexity  as  a  sensor  having  only 
eight  analog  channels.  Since  most  A/D  chips  and  embedded  processors  only  have  eight 
channels,  and  external  multiplexer  is  required  for  anything  having  more  than  eight 
channels. 

If  the  MARG  sensor  could  be  redesigned  with  eight  analog  channels,  the  goal  of  a 
wireless  MARG  sensor  system  would  be  easily  realizable.  This  chapter  examines  ways  of 
redesigning  the  MARG  sensor  to  use  only  eight  analog  channels. 

B.  REDUNDANT  SIGNALS 

The  best  chance  of  eliminating  an  analog  signal  without  reducing  performance 
was  to  find  a  signal  that  was  not  needed.  The  angular  rate  sensors  were  considered 
essential  because  they  provided  instantaneous  response.  The  accelerometers  and 
magnetometers  were  only  used  to  correct  for  drift.  Both  the  magnetometers  and  the 
accelerometers  determine  orientation  by  measuring  a  vector’s  projection  on  three 
orthonormal  axis.  The  magnitude  of  the  vector  is  known.  Gravity  is  lg  and  the  Earth’s 
magnetic  field  is  ~0.6  gauss.  Using  two  known  components  of  the  vector,  the  magnitude 
of  the  third  can  be  calculated.  The  sign  of  the  third  component  cannot  be  calculated.  To 
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determine  the  sign,  the  output  of  the  third  sensors  would  go  to  a  single  bit  analog 
comparator.  The  output  of  the  comparator  represents  the  sign  in  digital  format. 

The  MARG  body  tracking  program  has  the  ability  to  save  sensor  data  and  filter 
results  to  a  text  file.  This  feature  enabled  experiments  to  be  performed  on  a  known  set  of 
data  and  allowed  direct  comparison  of  the  results.  To  perform  the  experiments,  the  C++ 
complementary  filter  code  was  ported  to  MATLAB.  The  MATLAB  filter  was  run  on  a 
know  set  of  data  to  verify  its  functionality. 

The  procedure  began  with  system  calibration.  Data  was  captured  using  all  nine 
sensors.  The  data  had  both  a  static  and  a  dynamic  period.  Then  the  data  was  processed 
two  more  times,  once  with  a  computed  magnetometer  channel  and  then  with  a  computed 
accelerometer  channel.  The  filter  gain  was  set  at  5  during  all  of  the  tests  with  equal 
weighting  given  to  the  magnetometers  and  the  accelerometers. 

1.  Static  Tests 

Angular  rate  sensors  sometimes  have  a  non-zero  output  even  when  held  in  a  fixed 
position.  This  can  be  caused  by  calibration  problems  or  drift.  Figure  13  shows  the  non¬ 
zero  output  of  the  angular  rate  sensors  during  a  static  test.  Using  data  from  the  three 
magnetometers  and  three  accelerometers,  the  complementary  filter  corrects  these  errors 
to  produce  an  output  that  is  constant  for  each  axis. 
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angular  rate  p 
angular  rate  q 
angular  rate  r 


raw  data 

Figure  13.  Static  Test  Angular  Rate  Sensor  Output 


In  this  series  of  tests,  the  filter  was  run  three  times:  first  with  all  nine  sensors  and 
the  two  more  times  with  eight.  In  the  first  test  with  eight  sensors,  one  of  the 
magnetometer  sensors  was  replaced  with  a  calculated  value.  The  second  test  with  eight 
sensors  had  an  accelerometer  output  which  was  replaced  with  a  calculated  value.  Figure 
14  shows  the  x-axis  output  of  the  filter.  In  this  figure,  the  filter  with  nine  sensors  is 
labeled  baseline.  The  filter  with  eight  sensors  and  a  calculated  magnetometer  is  labeled 
experimental.  Figures  15  is  the  y  axis  output  and  figure  16  is  the  z-axis  output  during  the 
same  test. 
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Figure  14.  Static  Magnetometer  Test  X-Axis 
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Figure  15.  Static  Magnetometer  Test  Y-Axis 
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Figure  16.  Static  Magnetometer  Test  Z-Axis 


Figures  17  through  19  show  the  data  from  the  calculated  accelerometer  static 
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Figure  17.  Static  Accelerometer  Test  X-Axis 
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Figure  1 8 .  Static  Accelerometer  T est  Y -Axis 
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Figure  19.  Static  Accelerometer  Test  Z-Axis 


All  angular  rate  sensors  had  a  none  zero  value  during  the  static  test.  During  the 
test  with  a  calculated  magnetometer,  the  output  converged  in  all  three  axis.  In  the  x-axis, 
the  output  converged  to  the  correct  value.  In  the  y  and  z  axis,  the  output  differed  by  7% 
from  the  correct  value.  The  accelerometers  appeared  to  have  performed  flawlessly. 
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2.  Dynamic  Tests 

These  tests  were  performed  in  the  same  manner  as  the  static  tests  except  the 
MARG  sensor  was  rotated  six  times;  two  rotations  about  each  axis  of  90  degrees  and  180 
degrees.  Figures  20  through  22  are  from  the  magnetometer  tests.  Figures  23  though  25 
are  from  the  accelerometer  tests. 
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Figure  20.  Dynamic  Magnetometer  Test  X-Axis 
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F igure  2 1 .  Dynamic  Magnetometer  T est  Y -Axis 
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Dynamic  Magnetometer  Test  Z-Axis 
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Dynamic  Accelerometer  Test  X-Axis 

Ongmal„i  13 


Baseline 

Experimental 


time  ( 0.01  seconds ) 


Figure  24.  Dynamic  Accelerometer  Test  Y-Axis 
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F igure  25 .  Dynamic  Accelerometer  T est  Z-Axis 

As  with  the  static  tests,  the  magnetometers  converged  to  an  incorrect  value.  This 
time,  the  error  was  much  more  pronounced.  The  accelerometers  did  have  large  errors 
immediately  following  a  rotation,  but  they  quickly  converged  to  the  correct  value.  The 
initial  error  was  expected  because  the  accelerometers  experience  dynamic  and  static 
acceleration  during  the  rotations. 

On  the  surface,  a  MARG  with  eight  analog  signals  (three  angular  rate,  three 
magnetometer  and  two  accelerometer)  seems  feasible.  Additional  experimentation  is 
required  to  verify  this.  The  experiment,  as  run,  had  too  many  variable  to  establish  cause 
and  effect.  By  testing  a  five  sensor  MARGs  (three  angular  rate  sensors,  two 
magnetometers  or  accelerometers)  against  six  sensor  MARGs  (three  angular  rate  sensors, 
three  magnetometers  or  accelerometers)  a  more  accurate  assessment  can  be  made. 

3.  Raw  Data 

The  magnetometers  converged  to  incorrect  values  during  some  the  tests  but  the 
accelerometers  always  converged  to  the  correct  value.  To  determine  the  difference,  the 
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raw  was  plotted  and  analyzed.  Since  the  calculated  values  were  based  on  the  assumption 
of  a  constant  vector  magnitude,  these  plots  were  examined  as  well.  Figure  26  shows  the 
magnitude  of  the  acceleration  vector  and  figure  27  shows  the  magnetic  field  vector. 


time  (  0.0 1  seconds  ) 


Figure  26.  Magnitude  of  Accelerometer  V ector 


The  accelerometer  vector  was  very  close  to  one  except  during  periods  of  linear 
acceleration.  This  was  expected.  What  was  not  expected  was  the  pronounced  variations  in 
the  magnetometers.  While  ferrous  metals  and  magnetic  sources  can  cause  variation 
similar  to  that  observed,  the  manner  in  which  the  experiments  were  conducted  makes  it 
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unlikely  that  this  was  the  cause.  The  variation  in  the  magnitude  of  the  magnetic  vector 
seemed  to  indicate  a  problem  with  the  calibration  routine. 


D.  SUMMARY 

The  experiments  involving  redundant  signals  looked  promising.  The 
accelerometer  test  show  that  angular  rate  sensor  errors  can  be  corrected  using  a  reduced 
number  of  sensors.  Additional  experiments  may  show  the  same  for  the  magnetometers. 

Examination  of  the  raw  data  indicated  possible  problems  with  the  sensor 
hardware  and  calibration  routines.  If  these  errors  are  found  and  corrected,  system 
performance  could  be  enhanced. 

The  MARG  sensors  were  constructed  over  a  year  ago  and  many  advances  have 
been  made  since  then.  Tokin  has  come  out  with  a  smaller  version  of  their  angular  rate 
sensor  and  Analog  Devices  released  an  accelerometer  with  twice  the  resolution  of  the 
ADXL05.  Analog  Devices  also  released  an  accelerometer  with,  digital  (pulse  width) 
outputs. 

While  we  were  unable  to  find  a  suitable  microcontroller  with  nine  A/D  channels, 
there  were  several  with  eight  A/D  channels  and  multiple  timers.  These  timers  can 
measure  the  pulse  width  of  a  digital  signal  and  would  allow  the  use  of  all  nine  sensors; 
six  with  analog  outputs  and  three  with  digital  outputs. 
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VL  CONCLUSIONS 


A.  SUMMARY 

While  the  previous  design  demonstrated  the  feasibility  of  body  tracking  using 
MARG  sensors,  it  required  the  user  to  be  tethered  to  a  desktop.  The  system  was  limited  to 
three  MARG  sensors. 

This  thesis  demonstrated  the  feasibility  of  a  wireless  MARG  body  tracking 
system  capable  of  sampling  five  MARG  sensors  at  100  Hz  and  15  MARG  sensors  at  37 
Hz.  The  working  radius  of  the  system  was  increased  from  five  feet  to  the  range  of  the 
wireless  LAN. 

A  new  system  was  proposed  which  solved  the  A/D  conversion  bottleneck  and 
replaced  the  remaining  cables  with  a  second  wireless  link.  To  facilitate  the 
implementation  of  the  proposed  system,  a  MARG  sensor  was  tested  using  only  eight  of 
its  nine  analog  channels.  The  MARG  testing  indicated  a  possible  problem  with  the 
MARG  sensors  or  the  calibration  routine. 

B.  SUGGESTIONS  FOR  FUTURE  WORK 

Work  on  the  wireless  link  between  MARG  sensors  and  the  computer  need  to  be 
continued.  If  the  MARG  sensors  are  equiped  with  an  embedded  processor,  it  would  be 
possible  to  perform  the  orientation  computations  inside  the  MARG  sensor.  Instead  of 
having  the  MARG  sensors  transmit  nine  channels  of  data  they  could  simply  transmit 
three  channels  of  orientation  information.  This  would  reduce  the  bandwidth  requirement 
by  a  factor  of  three  and  reduce  the  amount  of  computation  performed  by  the  computer. 
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